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Abstract: 


A Note  on  Optimal  Replacement  Policies 
for  Some  Shock  Models. 

Emad  El-Neweihi  and  Peter  Purdue 
Department  of  Statistics 
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Oist.  AVAIL  and/or  SPECIAL 

Optimal  replacement  policies  for  systems  subject  to  randomly  occurring 
shocks  are  obtained.  The  models  discussed  Include  cumulative  and  maximum 
damage  models  with  emphasis  on  systems  with  random  thresholds. 


1.  Introduction: 

The  problem  of  the  optimal  replacement  of  an  Item  which  falls  by 
degradation  caused  by  cumulative  damage  has  attracted  the  attention  of  a 
number  of  authors.  A good  summary  of  this  literature  Is  given  In  Taylor 
(1975)  and  the  references  contained  therein.  Taylor  discusses  a cumulative 
damage  model  where  shocks  of  a random  size  arrive  according  to  a Poisson 
Process.  The  Item  under  attack  can  fall  only  at  a shock  arrival  time  and 
the  probability  of  surviving  a shock  which  brings  the  total  damage  level 
to  X Is  h(x).  It  is  more  costly  to  replace  a failed  Item  than  one  which 
Is  still  working  and  the  problem  Is  to  find  an  optimal  replacement  strategy 
which  balances  these  costs  and  results  In  a minimum  long-run  average  cost 
per  unit  time.  The  solution  Is  given  by  Taylor  and.  In  the  special  case 
where  h(x)  ■ 1 for  0^x<K  and  0 otherwise  (the  fixed  threshold  case), 
Nakagawa  (1976)  Independently  determined  another  form  of  the  solution  using 
a simpler  approach  but  allowing  the  arrival  process  to  be  renewal.  Feldman 
(1976)  extended  the  model  to  the  case  of  a Markov  Renewal  shock  process. 
Feldman  and  Nakagawa  approach  the  problem  In  the  same  spirit.  Our  goal 
Is  to  extend  the  existing  results  to  the  case  of  a random  threshold;  the 
method  of  attack  is  In  the  same  vein  as  that  of  Feldman  and  Nakagawa. 


I 


2.  Maximum  Shock  Threshold  Model. 

We  consider  a device  which  is  subject  to  failure.  Shocks  occur  to  the 
device  according  to  a renewal  process  {X^;  i^l)  with  inter-renewal 
distribution  F.  The  i-th  shock  causes  an  amount  of  damage  W^^  where  the 
random  variables  {W^;  i^l}  are  independent  with  common  distribution 
function  G.  The  device  fails  whenever  an  arriving  shock  exceeds  the 

[ 

level  K.  When  the  device  fails  it  is  immediately  replaced  by  a similar  I 

! 

device.  However  we  have  open  to  us  the  possibility  of  replacing  the 
device  before  it  fails.  A cost  is  incurred  whenever  a failed  item 
is  replaced  whereas  a smaller  cost  C2  is  incurred  if  a device  is  replaced 
before  failure.  The  policy  sought  is  one  which  minimizes  the  long-run 
expected  cost  per  unit  time  over  an  infinite  horizon.  The  class  of 
policies  considered,  what  Feldman  calls  control  limit  policies,  are 
those  which  replace  the  device  whenever  a shock  of  magnitude  greater 
than  some  fixed  level  k occurs  (k  j<  K) . If  a cycle  denotes  the  time  span 
between  two  consecutive  replacements  then,  as  is  well  know,  the  long-run 
average  cost  per  unit  time  is 

“ E[cost/cycle]/E[length  of  the  cycle] 


(a)  The  fixed  threshold  case. 

In  this  section  the  threshold  level  K is  some  fixed,  non-negative 
number.  By  "policy  k"  we  mean  the  policy  which  replaces  a working  device 
whenever  a shock  of  level  greater  than  k occurs.  Let  C(k)  denote  the  total 
expected  cost  per  cycle  using  policy  k.  It  is  not  very  hard  to  show  that 
C(k)  - X{C^[1-G(K)]  + C2[G(K)-G(k)]}  where  j - E(Xj^). 


Then  as  k Increases,  C(k)  decreases  and  the  optimal  policy  is  to  run  the 
device  to  breakdown  each  time.  This  is  clearly  the  intuitive  solution  to 
the  problem. 


(b)  Random  Threshold  Model. 

In  this  section  we  assume  that  the  threshold  K is  a random  variable 

with  distribution  function  H.  All  of  the  other  model  assumptions  are  as 

before  (w.l.o.g.  we  can  assume  X « 1). 

00  , 

Letting  M(x)  * E [G(x)]''  we  have, 

j-1 


C,H(k)  + C,  [1+M(k)]  /.  [l-G(x)dH(x)  + C-[l-rtI(k)]  JT  [G(x)-G(k)dH(x) 

(1)  c(k)  - ^ ^ 

1 + /q  [l-H(x)]dM(x) 

To  derive  this  we  simply  condition  with  respect  to  K. 

Now  let, 

L(k)  - H(k){;^[-^ff]dH(x)  rtG(x)dHCx)^  _ 

0 H(k)  k 

where  H(x)  * l-H(x),  G(x)  ■ l-G(x). 

Leinma  (2.1).  L(k)  £ 0 for  all  k>0  and 
L(0)  - 0. 

Proof:  L(0)  ■ 0 is  obvious.  We  have, 

;J[l+M(x)]dH(x)  /*[l-G(x)ldH(x) 

- 11m  /J[l+M(x)]dH(x)  G(x)dH(x) 

b-K» 

. lim  U-Hn(5j^)lH(k)  G(^2^ 

t-KO 

. lin • [l-G(C,)][H(b)-H(k)]  < H(k)  H(k),  b > k. 


the  result  follows  at  once. 


} 
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We  will  now  assume  that  all  our  distribution  functions  are  absolutely  con- 
tinuous. 


Theorem  (2.2) 

For  the  maximum  shock  model  under  the  assumption  of  a random  threshold « 
the  optimal  policy  is  to  replace  only  on  failure. 


Proof: 


Differentiating  (1)  and  setting  the  derivitive  equal  to  zero  we  get, 

L(k)  « -z — z — . 

But  by  assumption  and  by  the  above  lemma  L(k)^0.  Hence  C’ (k)<0 

for  all  k^O  and  the  optimal  policy  is  to  run  the  device  to  breakdown. 


3.  Cumulative  Damage  Model  with  a Random  Threshold. 

Again  we  assume  that  shocks  arrive  according  to  a renewal  process  with 

inter-renewal  distribution  F having  mean  1.  The  shocks  are  Independent 

random  variables,  W^^,  which  have  a common  distribution  function  G. 

Let  N(t)  denote  the  number  of  shocks  which  arrive  in  (0,t];  the 

cumulative  damage  process,  W(t),  is  given  by, 

N(t) 

W(t)  - Z W , t > 0. 
i-1 

The  device  falls  only  when  W(t)  exceeds  a certain  level  K,  which  is  assumed 
to  be  a random  variable  with  distribution  function  H.  The  time  to  failure 
is 

Tj  - inf{f  W(t)  > K}. 

Using  policy  k we  have  that  the  replacement  time  of  a working  device  is 

Tj.  - inf{t:  W(t)  > k}. 

Then  the  length  of  a cycle,  T , is  given  by 


1 


Tj,  - inin(Tj^,T^). 


The  cost  structure  Is  the  same  as  In  section  2 and  our  goal  Is  to  find  a 
policy  k which  will  minimize  the  long-run  average  cost  per  unit  time. 


Now,  by  conditioning  on  K,  we  have  that,  using  policy  k, 

E(cost/cycle)  + (C^-C2){H(k)  + /”[G(B)  + G (e-u)dM(u) ]dH(B) } 

where  M(x)  = Z G(x) 

and  G(x)  Is  the  j-fold  convolution  of  G with  Itself.  We  also  have, 

E(Tj,)  = [l+M(k)]H(k)+  /Qtl-rtI(B)]dH(6). 

Finally,  If  C(k)  denotes  the  expected  cost  per  cycle, 

C,  + (C  -C-){H(k)  + A(k,0)  + /J^A(k,u)dM(u)} 

(2)  C(k)  - ^ ^ 2 

1 + /jH(x)dM(x) 

where, 

A(k,u)  = G(x-u)dH(x). 

Two  extreme  cases  are  when  k“0  and  “.  Then, 

C(0)  - Cj^{1-E[G(K)]}  + E[g(K)] 

Cl 

c(~)  -=  i+em(k) 

To  obtain  the  optimal  policy  we  Introduce  the  function  L(k)  defined  by, 

A(k,k)[l+/S^H(x)dM(x)]  - H(k)[H(k)+A(k,0)+./)5A(k,u)dM(u) 

L(k) ^ 

H(k) 

Again  we  will  assume  that  all  distribution  functions  are  absolutely  continuous. 
The  next  lemma  describes  some  properties  of  L(k). 

Lemma  (3.1)  L(0)*0.  Under  the  assumption  that  H Is  Decreasing  Failure 
Rate  or  that  the  failure  rate  Is  bounded  by  some  finite  constant, 

11m  L(k)  - EM(K). 

k-+oo 

Proof ; Clearly  L(0)“0.  We  can  write 

L(k)  - [l+/!S(x)dM(x)]  [H(k)+A(k,0)+/J;A(k.u)dM(u)]. 

“ H(k) 


r 
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The  second  term  on  the  right  goes  to  1 as  k-x».  Also, 


Finally 


lim[l+/QH(x)dM(x)]  - E[1+M(K)], 


lin 

k-»®  H(k) 


1 - lim 

k-H» 


G(x-k)h(x)dx 
■'k  l-H(k) 


where  h(x)  is  the  density  function  corresponding  to  H.  But 


^ G(x-k)h(x)dx 
\ l-H(k) 


£ G(x-k)  ]dx 

H(x) 


and,  under  the  assumption  of  the  lemma 


lim  . 1. 

k-«»  H(k) 


The  result  now  follows. 


Theorem  (3.2) 

Under  the  assumptions  of  Lemma  3.1  and  the  additional  assumption  that 
L(k)  is  monotonlcally  increasing  then 

(1)  If  EM(K)  > exists  an  optimum  policy  k*  which 


satisfies 


L(k) 


(11)  If  EM(K)  < 7; — p;—  then  the  optimal  policy  is  to  replace  only  after 

C1-C2 

failure. 


Proof:  Differentiating  (2)  with  respect  to  k,  setting  equal  to  0 and  using 
Lemma  3.1  gives  the  desired  result.  We  next  consider  an  example  where  the 
shock  process  is  Poisson  and  the  threshold  is  Exponential.  Due  to  the  lack 
of  memory  property  of  the  exponential  we  would  expect  the  optimal  policy 
in  this  case  to  replace  only  on  failure;  this  is  shown  to  be  so. 


A 
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